Only broke one bit, though, but first I broke off the tip of the easy-out I tried to use... :-/ And then I had to drill THAT out...
The Dremel tool did an excellent job at getting out the easy-out, and then I kept alternating between it and metal-drilling drill bits, and eventually popped through.